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REMARKS: 

. Claims 1-12 are pending in the application. Claims 1-12 were rejected under 35 U.S. C. § 
103(a). Claims 1, 5 and 9 are the only independent claims. 

The specification has been amended to place the application in correct idiomatic English. 
Claims 1-12 have been amended to place the claims in better U.S. form without narrowing the scope 
of the claims as filed. 

Attached hereto is a marked-up version of the changes made to the specification and claims 
by the current amendment. The attachment is captioned " Version with Markings to Show Changes 
Made ." 

The drawings were objected to for the reasons discussed on page 2 of the Office Action. The 
objection to the drawings is traversed for the following reasons. 

It is respectfully submitted that the drawings conform with 37 CFR §§ 1.81-1.84. It is 
respectfully requested that if the Examiner disagrees with such an assertion, that the Examiner 
explicitly point out how the drawings do not conform with 37 CFR §§ 1.81-1.84. 

Page 2 of the Office Action indicates that the "drawings are objected to because they are not 
clearly described in the specification, which made them hard to comprehend." It is true that the 
Examiner determines completeness and consistency of the drawings. However, as discussed inMPEP 
§ 608.02(e) the Examiner should: 

see to it that the Figures are correctly described in the brief description 
of the several views of the drawing section of the specification, 
that the reference characters are properly applied, that no single 
reference character is used for two different parts or for a given part 
in a modification of such part, and that there are no superfluous 
illustrations. 

It is respectfully submitted that the drawings conform with Section 608.02(e) of MPEP. 

Furthermore, it is respectfully submitted that the specification contains a written description 
of the invention, and of the manner and process of making and using it, in such full, clear, concise and 
exact terms as to enable any person skilled in the art to which pertains, or with which it is most clearly 
connected, and to make and use the same in accordance with 35 U.S.C. § 1 12, first paragraph. As 
evidence that the specification, which includes the drawings, conforms with 35 U.S.C. § 112, first 
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paragraph, it is respectfully submitted that the Examiner did not object to the specification or reject 
the claims under 35 U.S.C. § 1.12, first paragraph. 

In light of the above discussion, Applicants respectfully submit that the drawings comply with 
35 U.S.C. § 112,CFR§§ 1.81-1.84 and MPEP§ 608.02(e). Applicants request that if the Examiner 
maintains the objection to the drawings, that explicit reasons therefore be provided. Otherwise, it is 
respectfully requested that the objection to the drawings be withdrawn. 

The title of the invention has been changed to a new title that is clearly indicative of the 
invention to which the claims are directed, as required on page 2 of the Office Action. 

It is respectfully submitted that claims 1-12 are patentable within the meaning of 35 U.S.C. 
§ 103 over Applicants' admitted prior art in view of Cree and in further view of Higley, for the 
following reasons. 

The present invention relates to a multi-media E-mail system and device for 
transmitting/receiving, through a network, multi-media E-mails each including various types of media 
information such as text, images and audio information. 

In accordance with one aspect of the present invention, as a sender of an incoming mail 
possesses the incoming mail (that is, information identical to the received media information is stored 
as transmitted media information on the sender side), there is no need to send the received media 
information back to the sender if the return mail is composed by utilizing the media information 
included in the incoming mail (that is, if the return mail includes the received media information). 
Therefore, the multi-media E-mail to be transmitted to the sender does not include the received media 
information. On the contrary, the multi-media E-mail to be transmitted to the sender only includes 
information objects that were not included in the received multi-media E-mail. 

In this manner, when a multi-media E-mail that comprises objects of various types of media 
information (each temporally and/or spatially related to one another) is transmitted/received through 
a network, the received media information do not go through the network twice. Therefore, 
information volume is reduced. 
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Independent claim 1 as amended, requires a multi-media E-mail method comprising, inter alia, 
transmitting the composed return mail back to the sender in the form of a multi-media E-mail 
including all the restored information objects and the restored positioning control information 
exclusive of the received information objects and the positioning control information. Claim 5 as 
amended requires a multi-media E-mail device comprising, inter alia, a transmission controlling part 
operable to transmit the return mail to thesender in the form of a multi-media E-mail including all the 
restored information objects and the restored positioning control information exclusive of the received 
information objects and the restored positioning control information. Claim 9 requires a recording 
medium having a computer readable program stored thereon, the program comprises instructions 
operable to instruct a computer to, inter alia, -transmit the composed return mail to the sender in a 
form of a multi-media E-mail including all the restored information objects and the restored 
positioning control information exclusive of the received information objects and the positioning 
control information. 

It is respectfully submitted that neither the Applicants' admitted prior art, Cree nor Higley, 
either singly or in combination teaches the above-identified limitations. 

Page 3 of the Office Action indicates that the Applicants' admitted prior art "fails to teach a 
step of composing a return mail for restored incoming mail by utilizing said received media 
information." The Office Action further states that the Applicants' admitted prior art and Cree "fail 
to teach a step of transmitting the composed return mail back to the sender in the form of a multi- 
media E-mail including every media information included in the return mail exclusive of said received 
media information and the positioning control information indicating how the every media information 
in the return mail is each temporally and/or spatially positioned." Page 4 of the Office Action then 
asserts that Higley teaches this limitation and cites Fig. 6; column 5, lines 9-12; column 7, lines 45-52 
of the reference. 

It is respectfully submitted that, contrary to the assertion on page 4 of the Office Action, 
Higley fails to teach the above-identified limitations. As described from line 65, column 2 through 
line 33 of column 3 of Higley, the reference deals with a method of transmitting a URL via E-mail 
from a sender to a receiver in a way that the URL is easily viewed by the receiver upon receipt. 
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Referring to column 5, lines 1-18, and Fig. 4 of the reference, it is described that a document (email) 
containing a URL is created and that the E-mail is transmitted to a receiver. Upon receipt of the 
email, the URL may be automatically dereferenced such that the receiver views the contents of the 
URL automatically (column 5, lines 27-53). 

Higley fails to teach sending a reply email back to a sender which contains only the media 
information that was not included in the original email sent from the sender. Accordingly, it is 
respectfully submitted that Higley fails to teach the above-identified limitations. 

In view of the above remarks, Applicants respectfully submit that claims 1, 5 and 9 would not 
have been obvious over the combination of the Applicants' admitted prior art in view of Cree and in 
further view of Higley, and urge that the rejection of claims 1, 5 and 9, and their respective dependent 
claims 2-4, 6-8, and 10-12, under 35 U.S.C. § 103(a) be withdrawn. 

Having fully and completely responded to the Office Action, Applicants submit that all of the 
claims are now in condition for allowance, an indication of which is respectfully solicited. 

If there are any outstanding issues that might be resolved in an Interview or an Examiner's 
amendment, the Examiner is requested to call Applicants' attorney at the telephone number shown 
below. 

Respectfully submitted, 
Satoshi KAJITA et al. 

g„ w ft Ma 



By:_v^ 

Thomas D. Robbins 
Registration No. 43,369 
Attorney for Applicants 



TDR/abm 

Washington, D.C. 20006-1021 
Telephone (202) 721-8200 
Facsimile (202) 721-8250 
November 12, 2002 
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Version vriih Marking to 

Show Change TV/Torlo 

TITLE OF THE INVENTION 

MULTI -MEDIA E-MAIL SYSTEM AND : DEVICE _._r^ • 

BACKGROUND OF THE INVENTION 
5 Field of the Invention 

The present invention relates to E-mail systems and devices . 
more particularly to a multi-media E-mail system and device for 
transmitting/receiving, through a network, multi-media E-mails 
each including various types of media information such as text. 
10 images, audio information. ,„.„.,. ( - < 

Description of the Background Art 

In conventional multi-media E-mail systems, images (image 

information) or audio information associated with text (text 
15 information) has been transmitted, for example, in an attachment 
file coming with a text file. In this system, when a receiver 
opens a multi-media E-mail, he/she will find two icons 
respectively indicate a text file and attachment file on a screen. 
With a click on these icons , the attachment file is opened with 
20 images on the screen or audio from a speaker. 

In such conventional E-mail systems that transmit images 
or audio information in the attachment file, however, audio 
associated with text does not synchronize with the text , or images 
are not switched in synchronization with audio. This is because, 
25 timing is up to the receiver when to open the attachment file. 
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#2 and #3, respectively, and then stores the same in the inputted 
information storing part 2505. Thereafter, the inputted image 
of human body is identified as an object #2 , and image of landscape 
as an object #3% 

5 Next, the sender records audio by using a microphone (not 

shown), for example, and then the audio inputting part 2502 
receives the audio responding thereto- The inputted information 
editing part 2506 provides the inputted audio information with 
an identifier #4, and then stores the same in the inputted 
10 information storing part 2505. Thereafter, the inputted audio 
information is identified as an object #4. 

Then, the sender taps on the'not- shown keyboard, for example, 
so as to specify temporal and/or 2D spatial relationship among 
the objects by referring to the mail-composing window in FIG. 27 
15 displayed on a not -shown display. 

In this manner, the mail is composed. The composed mail 
is displayed on the display via the inputted information 

presenting part 2507 (see FIG. 28). In FIG. 28, each of the 

i 

objects is provided with the identifier, and 'also is perceivably 
20 indicated when and where to be presented ^until when. 

The composed mail has such internal data structure as shown 
in FIG. 29. Specifically, elements in the data structure are: 
a media identifier field storing media identifiers (# number) 
uniquely identifying media information ; a media information field 
25 storing substance (actual information) of the media information 

6 



receiving terminals shown in FIGS. 25 and 26, the media 
information included in the mult i -media E-mail is each treated 
as an object, and is transmitted together with the control 
information indicating when and where to present each object. 
Therefore, the media information in the multi-media E-mail can 
be each temporally and/or spatially related to one another. To 
be specific , in the mail , audio can synchronize with text on the 
screen, or images can be switched in synchronization with audio. 
Thanks to such improvement , E-mail will be widely prevalent within 
the foreseeable future. 

■ It is predictable, however, the information volume to be 
transmitted will see a leap as the multi-media E-mail system 
becomes prevalent , and resultantly networks will be deficient in 
capacity. At the same. time, as the audio or image is much larger 
in volume than the text, time and cost required for the 
communications will be an issue for users. Nevertheless, the 
other conventional system has not been working out and applying 
any solution to decrease the to-be-increased information volume. 

SUMMARY OF THE INVENTION 

Therefore, an object of the present invention is to provide 



Sfcchmulti-media E-mail system and device that transmiWreceive? 
A 

through a network, multi-media E-mails each having various types 
of media information being temporally and/or spatially related 
to one another, and further, reduce^Lnformation volume going 

■ • " : 8 
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through the network. 

'i 

The present invention has the following features to solve ^ 



the problem/above. 



A first aspect of the present invention is directed to a 
multi-media E-mail system for transmitting/receiving a multi- 
media E-mail including various types of media information and 
positioning control information: indicating how the media 
information is each temporally and/or spatially positioned^he 

multi-media E-mail system compris±ng:n 

^ *J 

a -stop- -of ^receiving the multi -media E-mail; >n 

— ' ^ 



,a-o top of ^restoring an incoming mail composed by a sender 
of the received multi-media E-mail by positioning the media 
information each included in the received multi-media E-mail 
according to the positioning control information included 
15 therein 

a- bLey of 1 storing the media information included in the 
received multi-media E-mail as received me dia information ;^ 

.a-stsp-of /composing a return mail for the restored incoming S 
mall by utilizing the received media infor mation; an d^ 

-ars-tep-of ^transmitting the composed return mail back to the 
sender in a form of a multi-media E-mail including every media 
information included in the return mail exclusive of the received 
media information and the positioning control information 
indicating how the every media information in the return mail is 
25 each temporally and/or spatially positioned. 
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In this manner, when such multi-media E-mail that various 
types of media information included therein is each temporally 
and/or spatially related to one another is transmitted/received 
through a network, received media information does not go through 
the network twice . Therefore , information volume going 
therethrough can be reduced. ■" ■ . + 

According to a second aspect, ^41^ the first aspect, n 

(^X** ~ * 

*iaz±fe&=s£ap— of composing the return mail. 



£the received media informa tion jLs divided, ^ and^ 
Cthe return mail is composed by using divided media 
information obtaine d by the di vision, and s\ 

ia fclae-_£££P----e£. transmitting the return mail, as an 

alternative to the divided media information, division 
controlling information indicating at where the received media 
information is divided is transmitted in addition to the 
multi-media E-mail . - 

As described above, in the second aspect, when a return mail 
is composed by utilizing received media information, any one of 
the received media information is divided into various divided 
media information. In this manner, one or more divided media 
information can be deleted, interchanged with another, or new 
media information can be inserted between any two successive 
divided media information (dividing position). 

Further, when the received media information is divided, 
the multi-media E-mail to be transmitted to the sender further 




* 'J 

* '" 

includes division controlling information indicating at where the 
received media information is divided (for example, when the 
received media information is moving images , it is represented 
by frame number, and text data by line number) as an alternative 
5 to the divided media information. Accordingly, as the divided 
media information is not sent back to the sender, information 
volume going through a network can be reduced. 

According to a third aspect, iru the first' aspect, the 
multi-media E-mail system further comprises -ars*^-of storing the 
10 media information included in the mult i -media E-mail to be 
transmitted as transmitted media information, wherein/i 

23*-±h©-»t^ incoming mail, by positioning 

the media information each included in the received multi-media 
E-mail and the transmitted media information according to the 
15 positioning control information included in the multi-media 
E-mail, the incoming, mall is restored. 

As described above, in the third aspect, media information 

i 

included in a mail (outgoing mail) to be transmitted is stored 

as transmitted media information • If a return mail for the 

20 outgoing mail is received, mfedia information included in the 

received multi-media E-mail and previously- stored transmitted 

media information is positioned according to positioning control 

information included in the multi-media E-mail, In this manner, 

the incoming mail (return mail) can be restored. 

25 According to a fourth aspect, -ift-the third aspect, ia^the 

A 
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«*ep-~e£. composing the- return mai'l^ 

c^Ehe received media information is divided, and 



Vthe return mail is composed by using divided media 
information obtained by the division ,n 



-±n — the — sLey uf - transmitting the return mail, as an 
alternative to the divided media information, division 
controlling information indicating at where the received media 
information is divided is transmitted in addition to the 



multi-media E-mail, and^ 



10 In Llic otop o £ restoring the incoming mail,^\ 

r^the transmitted media information is divided 
according to the division controlling inf ormation included in the 
received multi-media E-mail, andyl 



(-the incoming mail is restored by using the divided 
15 media information obtained by the division. 

As described above, in the fourth aspect, when a return mail 
is composed by utilizing received media information, any one of 
the received media information is divided into various divided 
media information. In this manner, one or moire divided media 
20 information can be deleted, interchanged with another, or new 
media information can be inserted between any two successive 
divided media information (dividing position). 

Further, when the received media information is divided, 
a multi-media E-mail to be transmitted back to the sender further 
25 includes the divided media information indicating at where the 
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received media information is divided (for example, when the 
received media information is moving images, it is represented 
by frame number, and tekt data by line number) as an alternative 
to the divided media information Accordingly, as the divided 
media information is not sent back to the sender, information 
volume going through a network can be reduced. 

Still further, when a return mail is received, divided media 
information is first generated from the transmitted media 
information according to the division controlling information, 
and then the media information included in the received 
multi-media E-mail and the generated divided media information 
is positioned according to the positioning control information 
included in the multi-media E-mail- In this manner, the incoming 
mail (return mail) can be restored, 

A fifth aspect of the present invention is directed to a 
multi-media E-mail device for transmitting/receiving a multi- 
media E-mail including various types of media information and 
positioning control information indicating how the media 
information is each temporally and/or spatially positioned^^he 
multi-media E-mail device^comprisiag:^ 

Ca receipt controlling part in which the multi-media E-mail 
is received, and then an incoming mail composed by a sender of 
the received mult i -media E-mail is restored by positioning every 
media information included in the received mult i -media E-mail 
according to the positioning control information included 
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therein; 

C a first inputted information storing part storing the media 
information included in the multi-media E-mail received by the 
receipt controlling part as received media Information;^ 
5 ^an inputted information editing part composing a return 

mail for the incoming mail restored by the receipt controlling 
part by utilizing the received media information; and; — * 

^a transmission controlling part transmitting the return 
mail composed by the inputted information editing part back to 
10 the sender in a form of a multi -media E-mail including every type 
of the media information included in the return mail exclusive 
of the received media information and the positioning control 
information indicating how the every media information in the 
return mail is each temporally and/or spatially positioned. 
15 According to a sixth aspect, ±n: the fifth aspect,-^* 



/v. 



^when.a return mail is composed, the inputted information 
editing part— 

'divides the received media information, and. 



composes the return mail by using divided media 
20 information obtained by the division, and^ 

r"th€T t r ansmis s ion controlling part transmits , as an 
alternative to the divided media information, division 
controlling inf ormation indicating at where the received media 
information is divided in addition to the multi-media E-mail. 
25 According to a seventh aspect, ^in the fifth aspect, 

15 



the multi-media E-mail device further comprises a second 
inputted information storing part storing media information 
included in a multi-media E-mail to be transmitted by the 
transmission controlling part as transmitted media information, 
5 wherein^ 

Cthe receipt controlling part restores an incoming mail by 
positioning each type of the media information included in the 
received multi -media E-mail and the transmitted media information 
according to the positioning control information included in the 
10 multi-media E-mail* , 

According to an eighth aspect, the seventh aspect^ 



when a return mail is composed, the inputted information 
editing partjV 

(divides the received media information^ 
15 rcomposes the return mail by vising divided media 

information obtained by the division, and 

^ ; ' 

^the transmission controlling part transmits, as an 
alternative to the divided media information, division 
controlling information indicating at where the received media 
20 information is divided in addition to the multi-media E-mail, and 



when a return mail is restored, the receipt controlling part^ 



divides the transmitted media information according 
to the division controlling information included in the received 
multi-media E-mail, and 
25 -^restores the incoming mail by using the divided media 



.1,6 



information obtained by the division. 

A ninth aspect of the present invention is directed to a 
recording medium on which a program, to be run in a computer device , 
for transmitting/receiving a multi-media E-mail including 
various types of ' media information and positioning control 
information indicating how the media information is each 
temporally and/or spatially positioned is recorded^* the program 
for realizing an operational environment on the computer device 

©orapa?ir&±»g_: o. 

V7 e 

--^rgiep— ©f receiving the multi-media E-mail;^ 



-ar-&V&P"-xy£ ^restoriiwj an incoming mail composed by a sender 
of the multi-media E-mail by positioning every media information 

included in the received multi-media E-mail according to the 

* ... 

positioning control information included therein; ^ 

a— s*ep-o£/s t oriagTthe media information included in the 

received multi-media E-mail as received media information;^ 

J 

-a^reBp""o£^omposiiig_a return mail for the restored incoming 
mail by utilizing the received media information; and^ 



a^feep-ef ^transmitrbiRg the composed return mail back to the 
sender in a f brm of a mult i -media E-mail including every media 
information included in the return mail exclusive of the received 
media information and the positioning control inf ormation 
indicating how the every media-information in the return mail is 
each temporally and/or spatially positioned. 

According to a tenth aspect, in.th ninth aspect, v 
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j^'the .ft-t-Af^nfi- composing the return mail^s 



th e rec eived media information ts^dxv id^dy and^ 



the return mail is-cofflpoeed-by using divided media 



information obtain ed by the division, and 



-in — the — 3*ep_of transmitting the return mail,^ as an 
alternative to the divided media information, ^. div-x-s-i-on 
controlling information indicating at where the received media 
information is divided irs — traramitted— in addition to the 
multi-media E-mail. 

According to an eleventh aspect , -in the ninth aspect , 



<^he program for realizing the operational environment on 

^sV-W op*r A\cTo WTf uCC*e compter <Wt W 

the computer device further ^©ompsir&es*a-J5^ep-of storing the media 
information included in the mult i -media E-mail to be transmitted 
as transmitted media information, wherein^ 



iS^fcheL.^^ restoring the incoming mail, by positioning 
every media information included in the received multi-media 
E-mail and the transmitted media information according to the 
positioning control information included in the multi-media 
E-mail, the incoming mail is, restored* 

According to a twelfth aspect, the eleventh aspect, n 

C^oV,i(\ ■ ' : — • J < 7- ^ 

irn-H*ce--s1^p^©€ composing the return maiX, tw^ — £ ~~*£jUfc 



the received media information - lb - d readed, and 



^the'return mail is_c©mpcrsed by using divided media 
information obtained by the division,^ 7 * ' ' 



in— 4fee — step — o€- transmitting the return mail, as an 
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alternative to the divided media information, ^ division 
controlling information indicating at where the received media 
information is divided — trarxSlSrE^ed ! in addition 1 to the ^ 

y 



multi-media E-mail, and^ ' ^t \'°\ . ^^^ p> LOn ^t K 

4n-tfe o ote p ^o£- restoring the incoming mail. 



<^6he transmitted media information 4s — divided 
according to 'the division controlling information included in 
the receiv ed multi-media E-mail, and A , 

^^$ie° incoming mail t^-restoMd by using the divided 
10 media information obtained by the division. 

A thirteenth aspect of the present invention is directed 
to a method of supplying a program, to be run in a computer device , 
for transmitting/receiving a multi-media E-mail including 
various types of media information and positioning control 
15 information indicating how the media information is each 
temporally and/or spatially positioned to the computer device 
through a networkjo^be method comprising i*\ 



* er st ep o f ^receiving the mult i -media E-mail;^ 



■ a stap-^E-^restoring an incoming mail composed by a sender 
20 of the received multi-media E-mail by positioning each of the 
media information included in the received multi-media E-mail 
according to the positioning control information included in the 
multi-media E-mail;^ • ■ 

-ar-s*ep-j©£ ^storing the media information included in the 
25 received multi-media E-mail as received media information^, j 
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icomposing a return mail for the restored incoming 
mail by utilizing the received media inf ormat i on ; and /\ 

a^feep-T*<transmitting the composed 1 return mail back to the 
sender in a form of a multi-media. iSr.mail vincluding every media 
information included in the return mail exclusive of the received 
media information and the positioning control information 
indicating how the every media inf ormation in the return mail is 
temporally and/or spatially positioned. 

According to a fourteenth aspect , An. the thirteenth aspect, 
ajLjbho step of composing the r eturn mai l^ 

<*the received media information is divided, and 



<r£he return mail is composed by : Using divided media 

information obtained by the division, ahd ^ 

<^7Vtrv ^ 

±n — fE5 — atop — of. transmitting the return mail, as an 

alternative to the divided media information, division 

controlling information indicating at where the received media 

information is divided is transmitted in addition to the 

multi-media E-mail. 

?wTv:< to 

According to a fifteenth aspect , ±n the thirteenth aspect, 
the method of supplying a program further comprises -a—s*ep-o£ 
storing the media information included -in the multi-media E-mail 
to be transmitted as transmitted media inform ation, wherein ^ 

C v* r ' " 

in-the &%e^-e# restoring the incoming mail, by positioning 
y\ 

every media information included in the received mult i -media 
E-mail and the transmitted media information according to the 

20 



positioning control information included in the multi-media 
E-mail, the incoming mail is restored. 

According to a sixteenth aspect, in the fifteenth aspect,^ 



n ■ — r 



jua^ the step o f composing the return mail,^ 

Cthe received media information is divided, and 
^? 

<the return mail is composed by using divided media 
information obtai ned by th e division,^ 

in — the — r otop — transmitting the* return mail, as an 
alternative to the divided media information, division 
controlling information indicating at where the received media 
information is divided is transmitted in addition to the 
multi-media E-mail, and^ 

in- t he st:cp of restoring the incoming mail^^ 



the transmitted f media information is divided 
according to the division controlling information Included in the 
received multi-media, E-mail, and/\ 

Cthe incoming mail is restored by using the divided 
media information obtained by the division. 

These and other objects, features, aspects and advantages 
of the present invention will become more apparent from the 
following detailed description of the present invention when 
taken in conjunction with the accompanying drawings. 



BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 is a flowchart illustrating a multi-media E-mail 
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WHAT IS CLAIMED IS: 0 f- 

l^T^ti-media E-mail system ^transmitting/receiving 
a multi-media E-mail including^various types of media information 
and positioning control information indicating how the «ed±a^ ^ 
information i^e^h temporally and/or spatially positioned, ^e ^ 
multi-media E-mail -system comprising: QWt&f ^ 

«~s*ep-o*- receiving the multi-media E-mail; 

a atop of restoring raB^AReem^g-m^^ bv a oender ^ 

-of the received multi-media E-mail by positioning each of the 
^me^ia information Included in the received multi-media E-mail 
according to the positioning control information Included 

therein; 0 ^<cr<> 

storing the "media information included in the 

received multi-media E-mail as received media information ; 

incoming v/ 

'^3%W^/^ ( r 

and ^t>' * l i rrt*"'^ 

a otc p o f transmitting the composed return mail back to said 
sender in a form of a multi-media E-mail ^including A ev^y-med±tr 
information inclu de d in tho re t u r n m aj^exclusive of said received 
wea^r inf ormation^af d the positioning control information 
ia**eal. my.i« > w the avei* media information i n-t- he l e luiu mall Is 
eaeh--beii ip o rallY and/ or apa l lally positioned . 




2 . The. multi-media E-mail system according to claim 1 , 
^ wherein. ^eaid-^feep-trtE- composing the return mall^ 
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t 
I 



, ^said received media- information divid ed, and y v 

_______ = ■ ^ ^ focTS 

<^the return mail is composed by using^divided^jned-ia 

5 informa tion obtained by the division, and 

, JLit»\r\ <j0^ ,n 

in- said- -o*ep— of- transmitting the return mail, as an 
alternative to said -d-rawed \ media information, division 
controlling information indicating at where said received -meda_a 
information^^ divided is transmitted in addition to -said 
10 multi -media- E-mail. 

3) n The multi-media E-mail system according to claim 1, 
further comprising a otop - of storing the -media- information 
^Included in the multi-media E-mail 'to be transmitted as 

transmitted media information, "wlterej-n — 

5 W ^^a*ct^©p-of restoring the incoming mail ,4y positioning 

A. JaCC.'f 

each <media information^ included in the received multi-media 
E-mail and-stSa transmitted media information according to the 
positioning control information included in the multi-media 
E-mailg^the incoming mail ls~~restojred^ 



4. The multi-media E-mail "System according to claim 3, 
<- wherein in- sai d - ct e p -o f com posing the return mall^ 

sg±d received m®dia information^ rs- divid ed, and -n 
<^the return mail is composed by using* divided media- 
5 information/ obtained by the division, 

'^n ctMfl transmitting the return mall, as an 
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alternative to Said a±v*defl media information, division 
controlling information indicating at where T<mid received media- 
information^lSf divided is transmitted in addition to -said 
multi-media E-mail, and 

in mlfl ft^p restoring the incoming maii^ 

A ^ ^ — " oVgfo^r* 

C aaid — EFansmitted media information, £s- divided 

according to the division controlling information included in the 

received multi-media E-mail, and 

^ 

r~tne incoming mail is restored by using the divided 

media information obtained by the division'. 

S^^Tm^i -media E-mail device f or transmitting/receiving 
a multi-media E-mail including^various types of media Information 
and positioning control information indicating how the Tiredia- 
information^rCiach temporally and/or spatially positioned, the 

multi -media E-mail device comprising: 

a receipt controlling part fn-wh±ch the multi-media E-mallvn^r 

^eeeeivedo) and ttiBTr-wtlaeo^^ 

the received multi modla E-ma±3r-*s restore^ by positioning every 
-media, inf ormation^included in the received multi -media E-mail 

A. 

according to the positioning control information included 
therein; 

a first inputted information storing part storing the medl^ 
information^lncluded in the multi-media E-mail received by said 
receipt controlling part as received Iltedia information; 




15 \ an inputted information editing part^cfcmps&£»g a return 
mail v £or-t h e incoming mail rcotogod b y-sal^i-xeceip-t-uxtf rt 
pert by utilizing s^Ld received Ttiedia information ; and 

a transmission controlling part tran o mitt d^g- the return 

x 

mail -com posed by Said IhpUttad Inf orn r a l lun -editi ng , p a r fe-baxa* to 
20 sender in a form of a multi-media E-mail including ey®gy media ^ 

information includ ed in the return m a ll > exclusive of seid received 
-media information^ and the^ positioning control information 
i ndicating -hn w tb p pvpr^r Tn#»rH a Infnrmatinn in the return mail Is 
eaoh— t emp o r all y and/or spatial - ly positio nal 



6. The multi-media E-mail device according to claim 5, 



^Vi^t-pH n /whpn^jrpt-^rn m ai , T * s compose^ g^ said in putted information 

editing parti* o#«^ilc To* 
. /■ 

^dividey said received-media information, and 

5 compose^ the return mail by using divided media - 

0 k\*t7£ x ■ _ 

information obtained by the division^ and 

^said transmission controlling part ^ transmit^, as an 

alternative to si^d divided -stedia information, division 

controlling inf ormatioh t indicating "at where said received media 

10 information is divided in addition to raid multi-media E-mail. 



The multi-media E-mail device according to claim 5, 
further comprising a s cond inputted information storing part, 
storing the media information included in the multi-media E-mail 

A 
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to be transmitted by said transmission controlling part as 

5 transmitted media information- wherein ^ Q 

said receipt controlling parties tore^ the incoming mail 
by positioning each media information^ included in the received 
multi-media E-mail and fl^d transmitted media information 
according to the positioning control information included in the 

10 multi-media E-mail. 



X 



8. The multi-media E-mail device accordi ng to claim 7 , 
^whereln(ghen ja return maiT"ls^ mp^sjg?^ald Inputted information 
editing part "i so t «r*Uc To^ 



— - 4 V^I > 

^divide^J s2id received media information, and 
composed the return mail by using A divided -media 
information^obtalned by the division F" 



w said transmission controlling part^ transmit^, as an 
alternative to said divided - media information \ division 
controlling information indicating at where said received media 
10 information is divided in addition to said multi-media E-mail, 
and ^ — — ■ 



^(whei 
part fSopsr^Mr 



J^eiTa return mail is restor^jj^said receipt controlling 

/ v : — : ; ' : — -i :, " 



&f* T * _ 

divide^s^id transmitted tned^ci lnf ormation^according 
15 to the division controlling information included in the received 



multi-media E-mail, and^' 

^es^re^Tthe incoming mall by using the divided media 
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information obtained by the division. ' ! „ 

: 9 . a recording medium-e n whi ch a A program^t<>H5e- i *?««-H?H a 
computer device^-£or-transmitt±Rg/receiv±ag a multi-media E-mail 
including various types of media information and positioning 
control information indicating how the med±a : inf ormatlon^i-s-eaclL 
temporally and/ or spatially positioned i^ree<H?4ed , the program 
f or roali -Llnu mi "j r i-M n \ l-' i M 1 1^'"' i' ihi i hm i H. mi -^ld uuiiiuuLuj. d u vxce , 

comprising: r rom ase»^e r 

a - step ul j.eceivln g- the multi-media E-mail; 
a ct o p of j" li 1 1 1 n r 1 n j ~ aj> — * J | " 1 "" ' 1 1 U lumpu^ a "U'V a*«*d4M: 

_o*»the received multi-media E-mail by positioning each of the 
-mealia inf ormationjincluded in the received multi-media E-mail 
according to the positioning control information Included 

therein; - ^ 

-a-e%ep-of- storing the ritedi^ information^ included in the 
received multi-media E-mail as received media information; 

a-srey-of compos±Rg_a return mail for the restored incoming 
mair by utilizing iltia received media information; and 

-a-s4aap~ e£ transm itting the composed return mail^ack to'Srai.d 
sender in a form of a multi-media E-mail including e very media 
inf ormation^IncarB^ ed In the rotur irmzriA exclusive of -aa±d received 
-=me£tta information * and the, positioning control information 

* • 1 • i 

jLnddr oating how the e very mofria - ^if u^ ma l * o*»7&n^he^ 
S 5eh - ^c rapoxa3rly~an-dy-og-sf )at iall y - po &i t i oned». 



i To 



»r*'* ft/ 



;< 



10. The recording medium according to claim 9. whereirf in ^ 
^ ■-' A, "^2^e^-o^emWng L t^return mail^ <»~f-- 4 '^^^iJ^^yi 



ea^recelved me^hi^ information° l £4^dAvided t and^y 
C^h'e return mail is^eemposed by using divl^d~rttedia 



information obtained by the division, and 

, - v. -A. f ifvi 

saird— fffeep— o f transmittin g the return mail J as an 
alternative to said divided media information. ^division 
controlling Information indicating at where ba^d received media 
information * J*- divided is-teaasmittfiii in addition to 



tA^A^lo^ J 



n" 



10 multi-media E-mail. 



11'. The recording medium according to claim 9 , -t*e-^E©ga?am 
^^Lteto g - Llie upexaLl u iial envlr o nm o nt on th e compufcor devi ce ■ 
•tether coSgto4ng--g--STgeT- ! ^ st:o rl ng- the media information^ 1 
included in the multi-media E-mail to be transmitted as 



5 transmitted -media information 



/j-R-e aid step of rcot orin 




Scomingmail , .by positioning. 



each Mia inf ormation^included in the received multi-media 
E-mail and-sSd transmitted media information according to the 
positioning control inf ormation included in the multi-media 
10 E-mail^the--^^^ 



12 , The rec 




The^recording medium according to claim 11. 'wherein 



a l ii &ald - 3 - bop - of . compos'Sbn g the return mall^j 

~" — *^ 



received media inf ormation^ is divi^ed,^ and^ 
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% ^he returh : mall i-i^-dotflproed by using divided t^edia 
irifbr mati on^^btained by the division, 

A. 




;ep— transmit^Jntag- the return mailvr-^as an 
alternative to p aid divide d -media information, division 
controlling Information indicating at where s-ertt received media 
* - divided ±®— tea*wsm4**ei§ in addition to sadbd: 
multi-m edia E-mail, and 

ift-^&aid otop of restoring, the incoming mall j$ 




j^m^aiV' -said transmitted -med±a information^ is- d±v±deti- 
according to the division controlling information included in the 
received multi-media E-mail^ and^ 



'the incoming mail ie-ee^Dre* by using the divided 
-media information obtained by the division. 



13 . A method of supplying a program, to be run in a computer 
device, for transmitting/receiving a multi-media E-mail 
including various types of media information and positioning 
control information indicating how the media information is each 
5 temporally and/or spatially positioned to the computer device 
through a network, the method comprising: 

a step of receiving the multi-media E-mail; 

a step of restoring an incoming mall composed by a sender 
of the received multi-media E-mail by positioning each of the 
10 media information included in the received multi-media E-mail 
according to the positioning control information included 
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